Self- Assembling of Networks 
in an Agent-Based Model 
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We propose a model to show the self-assembling of network-like structures between a set of nodes 
without using preexisting positional information or long-range attraction of the nodes. The model 
is based on Brownian agents that are capable of producing different local (chemical) information 
and respond to it in a non-linear manner. They solve two tasks in parallel: (i) the detection of the 
appropriate nodes, and (ii) the establishment of stable links between them. We present results of 
computer simulations that demonstrate the emergence of robust network structures and investigate 
the connectivity of the network by means of both analytical estimations and computer simulations. 
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I. INTRODUCTION 

The emergence of network structures, i.e. the self- 
organized formation of links between a set of nodes is 
of crucial importance in many different fields. In elec- 
tronic engineering, for instance, one is interested in the 
self-assembling and self-repairing of electronic circuits 
jj], ||, ||], while in biology models for the self- wiring of 
neuronal networks are investigated |J. On the social 
level, the self-organization of human trail networks be- 
tween different destinations is a similar problem . Also 
the establishment of connections on demand in telecom- 
munication or logistics is related to the problem discussed 
here. 

A desirable feature of self-organized networks is their 
adaptivity. This means that new nodes can be linked to 
the existing network or linked nodes can be disconnected 
from the network if this is required, e.g. by the change 
of some external conditions. Noteworthy, such a behav- 
ior should be not governed by a "supervisor" or "dis- 
patcher" , it should rather result from the adaptive capa- 
bilities of the network itself. 

Such problems become even more complicated if no a 
priori information about the network structure is pro- 
vided, i.e. the network has to self-organize itself not only 
regarding the links but also regarding the nodes. This 
is the case for instance if the nodes to be linked to the 
network are "unknown" in the sense, that they first have 
to be discovered and only then can be connected. A com- 
mon biological example is the formation of a trail system 
in ants to connect a nest to a set of food sources that 
first have to be found |[. Such networks are known 
to be rather flexible and adaptive. After food sources 
are exhausted, they are "disconnected" from the existing 
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network, because they are no longer visited and the re- 
spective trail is no longer maintained, but newly found 
food sources can be linked to the existing network as well. 

Another important example for this kind of phenom- 
ena can be found in the self- wiring of neural structures. 
A neuron that grows from the retina of the eye towards 
the optic tectum (or superior colliculus) of the brain, does 
not "know" from the outset about its destination node in 
the brain, hence it has to navigate through an unknown 
environment in order to detect and to reach the appro- 
priate area. Neural growth cones appear to be guided 
by at least four different mechanisms: contact attraction, 
chemoattraction, contact repulsion, and chemorepulsion 
H . These mechanisms seem to act simultaneously and in 
a coordinated manner to direct pathfinding. Once these 
specific pathways are established, neuronal growth cones 
can navigate over long distances to find their correct tar- 
gets. 

It is known that gradients of different chemical cues 
play a considerable role in this navigation process. They 
provide a kind of positional information for the naviga- 
tion of the growth cones pf]| . Already in 1963 Sperry |ll[] 
proposed that positional information might be encoded 
in the form of gradients of signaling molecules that could 
be detected by the axons. I.e. axons could read positional 
information at every point on the tectum. Noteworthy, 
such an explanation assumes that the positional infor- 
mation resulting from the different gradients preexists in 
the environment. It may then provide a kind of long- 
range attraction or repulsion for the growth cones, which 
act together with other short-range mechanismis. 

This points to the question that shall be answered in 
this paper: Is it possible to link a set of nodes without 
using preexisting positional information or any kind of 
long-range attraction of the nodes? Can the process of 
generating positional information, i.e. the detection of 
"unknown" nodes and the estabishment of chemical gra- 
dients, and the process of network formation, i.e. the es- 
tablishment of links between nodes, occur in parallel, on 
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a comparable time scale, as a process of co-evolution? 

In order to show this, in Sect. II we introduce a model 
of Brownian agents that are capable of producing dif- 
ferent local (chemical) information and respond to it in 
a non-linear manner. In Sect. Ill, this model is applied 
to the formation of a network between a set of nodes. 
We present results of computer simulations that demon- 
strate the emergence of network structures. In Sect. IV, 
we investigate the network connectivity as a particular 
quantitative feature of the network by means of both ana- 
lytical estimations and computer simulations. In Sect. V, 
we conclude the results and comment also on the agent- 
based method used in this paper. 



II. MODEL OF BROWNIAN AGENTS 

The self-organization of a network is, in the consid- 
ered case, based on two different kind of activities: (i) the 
generation of positional information in terms of chemical 
gradients, (ii) the nonlinear response to the existing infor- 
mation in order to link the different nodes. These rather 
complex processes are not performed by usual physical 
particles, therefore we have introduced the concept of 
Brownian agents Jl2| as a simple way to consider certain 
activities within the framework of statistical physics. 

A Brownian agent i is characterized by different state 
variables that could be either external variables such 
as its position or its velocity Vi, or internal degrees 
of freedom. 9i for example is assumed a discrete valued 
parameter that allows to describe different responses of 
agent i to external signals, or different changes of its en- 
vironment. Because all kind of activities need energy, the 
agent's energy depot, ei is another important internal de- 
gree of freedom [[l3| . These state variables may change in 
the course of time, either or both by deterministic and 
stochastic influences. Similar to the description of Brow- 
nian motion, we will use a generalized Langevin equation 
for the Brownian agent (which also justifies its denota- 
tion). For the change of the agent's position we may as- 
sume an overdamped Langevin equation: 



drj 
dt 



dh e (r,t) 



Or 



(1) 



The second term denotes the stochastic influences, where 
£i(t) is white noise with (&(£)) = and {£i(t) £j(t')) = 
8ij S(t — t 1 ). The strength of the stochastic force Ei could 
be in general an individual parameter to weight the 
stochastic influences, this way it can for example mea- 
sure the individual sensitivity uji oc 1/ei of the agent. 
The first term denotes the deterministic influences that 
are in the considered case assumed to result from the 
gradient of an effective field h e (r,t). This field contains 
the positional information provided by different chemical 
cues as specified below. The parameter on describes the 
strength of the individual response of the agent to the 
field and weights the deterministic influences. on can be 
used to describe different responses to the field, e.g. 



(i) attraction to the field, on > 0, or repulsion, a* < 

(ii) response only if the local value of the field is above 
a certain threshold ho: ai = Q[h e (r,t) — ho], with 
@[y] being the Heavyside function: = 1, if y > 0, 
otherwise 9 = 0. 

(iii) response only if the agent has a specific internal 
value 9: ai = Sg i _g. 

Throughout this paper, we assume the two individual 
parameters as constants: ai = a — 1 and Si = D n where 
D n is the spatial diffusion coefficient, but we want to 
mention that the idea of an adjustable sensitivity has 
been successfully applied to model search problems with 
Brownian agents || [Uj . 

In addition to the movement of the Brownian agents, 
i.e. changes of their state variables r<, we also have to 
consider changes of their internal degree of freedom 9i (t) 
that in this application should have one of the follow- 
ing values: 9i S {0, — 1,+1}. Initially, 9i(t ) — holds 
for every agent. The parameter 9i can be changed in 
the course of time by an interaction between the mov- 
ing agents and the nodes. To be specific, we consider a 
two-dimensional surface, where a number of j_ = I, z 
nodes are located at the positions r| (cf. Fig. 



[l]). A num- 
ber of z + nodes should be characterized by a positive 



potential, Vj 



-I, while z_ 



z + nodes have a neg- 



ative potential, Vj = —1. We note explicitely, that the 
nodes do not have any long-range effect on the agents, 
such as attraction or repulsion. Their effect is restricted 
to their location, r | . 




FIG. 1: Example of a regular distribution of 40 nodes on 
a 100 x 100 lattice. For the computer simulations, periodic 
boundary conditions have been used. z+ = 20, Z- = 20. {x} 
indicates nodes with a potential Vj = —1, {+} indicates nodes 
with a potential Vj = +1. 

It is the (twofold) task of the Brownian agents, first 
to discover the nodes and then to link nodes with an 
opposite potential, this way forming a self-organized net- 
work between the set of nodes. If an agent hits one of the 
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nodes, its internal degree of freedom is changed due to 
the following equation: 



Adi(t) 



EM 



n(t))dr (2) 



The delta function is equal to 1 only for r? = Ti and zero 
otherwise. So, eq. (0) indicates, that a agent changes its 
internal state, Oi, only if it hits one of the nodes. Then 
it takes over the value of the potential of the respecting 
node, Vj, which means Oi remains constant if Vj = Oi, and 
Oi — > Vj, if Vj ^ Oi. We note that the probability for a 
(pointlike) agent to hit a (pointlike) node is almost van- 
ishing. However, the computer simulations discussed in 
the following section are carried out on a discrete lattice, 
so the agent and the node both have a finite extension, 
in which case eq. (||) makes sense. 

If the Brownian agent hits one of the nodes, this im- 
pact may result in an active state of the agent - a kick, 
originated by the potential, which may change the in- 
ternal parameter, Oi, due to eq. (||). In the active state, 
it is assumed that the agent is able to produce a chem- 
ical, either component (—1) or (+1), in dependence on 
the actual value of the internal parameter. We note that 
the agent's ability to produce the chemical in general 
depends on another internal parameter, namely the in- 
ternal energy depot that may set limits to the agent's 
activities. In this model however it is assumed that the 
internal energy depot is always sufficiently balanced, thus 
its influence shall be neglected here. The agent's chemical 
production rate, Si(0i,t), is assumed as follows: 



Si(M) 



+ exp{-/3+i 
(1-0*) A exp{-/3_!(t-t;_)} 



(3) 



Eq. (^) means that the agent is not active, as long as 
Oi = 0, which means before it hits one of the nodes the 
first time. After that event, the agent begins to produce 
either component (+1) if Oi = +1, or component (—1) 
if Oi = — 1. This activity, however, goes down with time, 
expressed in an exponential decrease of the production 
rate. Here, s ( j_ 1 ,s°_ 1 are the initial production rates and 
/3+i,/3_i arc the decay parameters for the production 
of the chemical components (+1) or (—1). Respectively, 
t l n i , t\_ are the times, when the agent i hits either a node 
with a positive or a negative potential. 

The spatio-temporal concentration of the chemicals 
shall be described by a chemical field hg(r,t) consist- 
ing either of component (+1) or (—1), which obeys the 
following equation: 



N 

-he h e (r,t) +y]si(fl*,t) Se-Bi S\r - r t (t) 



dh e (r,t) 
dt 

(4) 

The first term describes the exponential decay of the ex- 
isting concentration due to spontaneous decomposition 



of the chemical, where kg is the decomposition rate. The 
second term denotes the production of the field by the 
agents. Here, Sg-e i means the Kronecker Delta used for 
discrete variables, indicating that the agents only con- 
tribute to the field component that matches their internal 
parameter Oi. The Delta function S(r — r.i(t)) means that 
the agents contribute to the field only locally, at their 
current position, r^. Diffusion of the chemical substances 
is not considered here. 

The effective field, h e (r, t), is a specific function of the 
different components of the field, eq. ([|). It should influ- 
ence the movement of the agents according to the over- 
damped Langevin eq. (|l|) and dependent on their current 
internal parameter, Oi, as follows: 



dh_x(r,t) _ Q dh +1 (r,t) 



Or 



Or 



dh e (r,t) 
dr 

(5) 

Eq. (|6|) summarize the non-linear feedback between the 
field and the agents, as given by the eqs. (|3|) , (Q), (||): 



V^ e (r,t) 



Sz(0j,t) 





+1 V t h^{r,t) Si(+l,t) 
-1 Vih +1 (r,t) Si(-l,t) 



(6) 



Before presenting computer simulations, we would like 
to summarize our model of network formation that is in- 
troduced here in terms of a agent-based approach. Each 
agent is active in the sense that it can (i) move, (ii) pro- 
duce locally one out of two different chemical cues and 
(iii) respond to local gradients of these different chemi- 
cals. The actions of all agents are coupled indirectly via 
an effective field that is comprised of the two different 
chemical components. The agent activities further de- 
pend on an internal parameter Oi that allows to describe 
a different "behavior": Our model assumes, that agents 
with an internal state Oi = do not contribute to the 
field and are not affected by the field. They simply move 
like Brownian particles. Agents with an internal state 
Oi = +1 contribute to the field by producing the chem- 
ical cue (+1), while they are affected by the part of the 
field that is determined by chemical (—1). On the other 
hand, agents with an internal state 6i = — 1 contribute to 
the field by producing chemical (—1) and are affected by 
the part of the field, which is determined by component 
(+1). Moreover, if the agent hits one of the nodes, the 
internal state can be switched due to eq. (Q). Hence, the 
agent begins to produce a different chemical while beeing 
affected by the opposite potential. Precisely, at one time 
the agent does not respond to the gradient of the same 
field component, which it contributes to via producing a 
chemical. 

As the result of this non-linear feedback between the 
Brownian agents and the effective field generated by 
them, we can observe the formation of macroscopic struc- 
tures shown in the following section. 



III. SIMULATION RESULTS OF NETWORK 
FORMATION 

For the computer simulations, a triangular lattice with 
periodic boundary conditions was used. Further, we have 
assumed that the parameters describing the production 
and decay of the chemical, are the same for both compo- 
nents: 



+1 



P (7) 



The agents start initially at random positions and with 
the internal parameter 9i(t = 0) = 0. For the evolution 
of the network, we evaluate the sum h(r,t) of the two 
field components generated by the agents. For the plots, 
however, we have to match these values with a grey scale 
of 256 values, which is defined as follows: 



c(r,t) = 255 



1 - log 1 + 9 



h(r,t) - h min (t) 



At). 



h(r,t) = h+i(r,t) + h-x(r,t) 



(8) 



This means that the highest actual value, h max (t), always 
refers to black (c = in PostScript), whereas the actual 
minimum value, h m i n (t) encodes white (c — 255). Both 
extreme values change of course in time, therefore each 
snapshot of the time series presented has its own value 
mapping. 

As a first example, we show the evolution of the con- 
nections between four nodes (Fig. |J). In the course of 
time agents that have by chance discovered a node (this 
way going over into an active state) begin to perform a 
directed motion between the different nodes. Eventually, 
a link appears which can be clearly distinguished from 
the surrounding. 

Fig. |2| would suggest that in the course of time all 
nodes with an opposite potential should be connected. 
This however is not the case because the existing con- 
nections cause a screening effect that forces the agents 
to move along existing connections rather than making 
up new ones. This screening effect becomes more obvi- 
ous, when the number of nodes is increased. Fig. ^ shows 
the time evolution of a network, which should connect 40 
nodes (cf. also Fig. |l|). We see [^9| that in the course of 
time the agents aggregate along the connections, which 
results in higher agent concentrations and in higher fields 
along the connections. The self- assembling network is cre- 
ated very fast and remains stable in the long run. 

The time series of Fig. ^ indicates that for the forma- 
tion of the network a transient stage exists, during which 
new nodes are discovered and new connections appear. 
After the transient time tt r however the existing links 
are only stabilized, with small possible fluctuations. In 
order to get an estimate of the transient time, we have 
evaluated the total fraction xg(t) = Ng(t)/N of agents 
that currently have the internal parameter 8. The result 
shown in Fig. [| is based on the simulations of Fig. 0. It 
indicates that after t w 1500 simulation steps every agent 




(b) 




FIG. 2: Formation of links between 4 nodes: (a) initial state, 
(b) after 100 simulation steps, (c) after 1.000 simulation steps, 
(d) after 4.500 simulation steps. Lattice size 30 x 30, 450 
agents. Parameters: so = 25.000, kh = 0.01, (3 = 0.2, kh = 
0.01. 



has found at least one node by chance, thus changing its 
internal parameter either to (+1) or to (—1). Further, 
after this time the share between these internal param- 
eters is almost equally balanced, with slight fluctuations 
around xg = 0.5, dependent on the actual position of the 
agents. 

In fl~5| , we have shown that the equations for xg (t) read 
explicitely: 



x (t) = 1 exp -j -D n Z+ . Z I 



xg{t) 



zo 



Z + + Z- 

0e{-l,+l} 



.4 



z + + z_ 
1 — exp < — D n ; 1 



(9) 



.4 



In the asymptotic limit, the fraction xe is determined 
by the appropriate number of nodes, which change the 
internal state of the agents into 9. The transient time tt r 
can be estimated by assuming that the difference between 
xg(t) and the stationary value xf at should be smaller 
than a certain value, k: 



ttr > 



A 

D n Z 



hi 



(10) 



For D n = 1, we find for n = 10~ 2 a transient time of 
t tr = 1150, and for k = 10 -3 t tr — 1700, which is in good 
agreement with the results of the computer simulations. 
After that time, the assembled network should remain 
almost stable. 
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FIG. 3: Time series of the evolution of a network (time in 
simulation steps). The initial state is shown in Fig. [[]. Param- 
eters: 5.000 agents, s = 10.000, k h = 0.03, (3 = 0.2. 




Patterns like the network shown are intrinsically de- 
termined by the history of their creation. It means that 
irreversibility and early symmetry breaks play a consid- 
erable role in the determination of the final structure. 
The location of the different nodes acts more or less as 
a boundary condition for the structure formation which 
sets limits to the achievable structures, but does not de- 
termine the way of connecting the different nodes. 

Despite the fact, that in Fig. || almost all nodes are 
connected by at least one link, only some out of all pos- 
sible connections have been realized. In particular, only 
nearest neighbour nodes with opposite potentials are con- 
nected. This is partly due to the screening effect that 
makes longer connections an unlikely event, but also in- 
dicates that a maximum distance L* between two nodes 
exists, which can only be connected by the agents. An 
approximation for this critical distance is given in [ jl6| . 

Eventually, we note that the network formation is not 
restricted to regular or symmetric distributions of nodes. 
Fig. |E| shows a simulation, where different nodes are con- 
nected with a center. 




FIG. 5: Formation of links between a center (z_ = 1) and 
surrounding nodes (z+ = 7) after 10.000 simulation steps. 
Lattice size: 50 x 50, 2.000 agents. Parameters: so = 20.000, 
k h = 0.02, P = 0.2. 

In H we have also discussed a different variant of the 
model to demonstrate its flexibility in connecting addi- 
tional nodes to the network, or disconnecting obsolete 
Further, 



ones. 



1G 



we have shown that the switching 
behavior between a connected and a disconneced state 
can be very short, which would allow the construction of 
a dynamic switch. 



2000 4000 6000 8000 10000 
t 



IV. ESTIMATION OF THE NETWORK 
CONNECTIVITY 



FIG. 4: Fraction xg of agents with the internal parameter 6 
vs. time in simulation steps. (0) : 6 = 0, (O): 8 = +1, (□): 
6 = — 1. The values are obtained from the simulation, Fig. pi 
Initial conditions: xq = l,x±i = 0. 



A. Definition of Connectivity 

In order to characterize a network, one of the most 
important questions is whether two nodes k and I are 
connected or not. In the model considered a connection 
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is defined in terms of the chemical field h(r, t) produced 
by the agents. During the first stage of the network for- 
mation, the agents have randomly visited almost every 
lattice site before their motion turned into a bound mo- 
tion between the nodes. Therefore, the field h(r,t) has 
a non-zero value for almost every r, which exponentially 
decays, but never vanishes. Hence, in order to define a 
connection in terms of /i(r,i), we have to introduce a 
threshold value h t hr, which is the minimum value consid- 
ered for a link. More precisely, a connection between two 
nodes k and I should only exist if there is a path a G A 
between k and I along which the actual value of the field 
is larger than the threshold value: 



h(a,t) > h t hr for a G A 



(11) 



Such a definition does not necessarely assumes that the 
connection has to be a direct link. Instead, it could be 
any path a, which may also include other nodes, as long 
as the value h(a, t) along the path is above the threshold. 
We want to define the local connectivity Eik as follows: 



1 if k and I are connected by a path a G A, 
Eik = ^ along which h(a, t) > h t hr 
otherwise 

(12) 

We note that the connectivity Eik does not change if two 
nodes k and I are connected by more than one path. 

If we consider a number of z nodes, then the global 
connectivity E that refers to the whole network is defined 
as follows: 



E 



J2 

k=l l>k 



tti '(-''a 



2 2 



l>k 



Eik 



(13) 



k=l l>k 



Dependent on the configuration of nodes, there may be 
numerous different realizations for the connections, which 
result in the same connectivity E. 



B. Estimation of the Theshold Value 

In order to use the definition for the connectivity to 
evaluate the simulated networks, we first have to define 
the threshold value hthr- This should be the minimum 
value of h(r, t) along a stable connection between two 
nodes. For our estimations, we treat the connection be- 
tween two nearest neighbor nodes k and I as an one- 
dimensional structure, where x is now the space coordi- 
nate, and L the linear distance between the two nodes 
k and I. The node at x = should have a positive po- 
tential V = +1, while the node at x = L has a negative 
potential V = — 1: 



We assume that a stable connection exists if both field 
components hg(x, t) have reached their stationary values: 



dhg(x, t) 
dt 



= -keho(x,i)+y^Si(0,t) §{x-Xj) = (15) 



Of course, we do not know, how many agents are actually 
on the connection between k and I. For our estimations 
we have to bear in mind that hthr should determine the 
lower limit of the possible values of h, therefore it is jus- 
tified to assume the worst case, which means that the 
local number of agents at a specific location is just given 
by the average agent density h — N/A, where TV is the 
total agent number and A is the surface size. Further, 
we found in the computer simulations (cf. Fig. ^), that 
in the long-time limit the agents are equally distributed 
between the two internal states, 9 € {+1, — 1}. Hence, we 
assume that on any location along the connection there 
are ng = n/2 agents in state 9. Using this lower limit for 
the agent number, the delta function in eq. ( p"5"| ) can be 
replaced by n/2 = N/2 A in the continuous limit. 

Further, we consider that the agents move along the x 
coordinate with a constant velocity (which also matches 
with the assumption v ~ of the overdamped Langevin 
equation) : 



v = \v\ 



t 



< x < L 



(16) 



This allows us to replace t in the time dependent produc- 
tion rate, Si(9,t). With these simplified assumptions and 
the conventions, eq. (|7|), eq. ( |l5| ) reads for component 
9 = +l: 



= -k. 



h +1 (x,t) + ~a exp{-p-j (17) 



dh+\(x, t) 
dt 

Integration of eq. fi"7| ) yields with h + i(x, t = 0) = 0: 

h +1 {x,t) = exp{-/3^} (l - expj-fcfti}) (18) 

Eventually, for t — > oo we find from eq. (|T^) the station- 
ary solution: 



h+i{x) = -— exp< --x 
2 kh v 



(19) 



The remaining field component h-i(x\ t) should have the 
same stationary solution as eq. (|l9|), with x' = L — x. The 
resulting total field h(x,t) reads in the stationary limit 
(cf. Fig. §): 



h(x) = h + i(x) + h-i(L — x) 



(20) 



n so 
2 k h 
< x < L 



exp | — — a; j + exp | — — (L — x) | 







0<x<L; V(0) = +1 ; V(L) 



-1 



(14) 
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80000 




FIG. 6: Stationary solutions for h+i(x), eq. ( Jig| ) (■■■), h-i(x) 

( ) and h(x), eq. © ( ). L = L max /2, eq. (g). The 

threshold /i t hr is defined as the minimum value of h(r,t) in 
the stationary limit. For the parameters see Fig. |5| 



The threshold hthr should be defined as the minimum 
of h(x), which yields for L/2. As the result, we find: 



Hhr 



Nso 
Ah 



exp 



(3 L 
'v 2 



(21) 



Here, the threshold value is a function of the mean agent 
density n, the parameters so, kh and /3 and the distance 
between the two nodes, L. However, due to the decay of 
the field (kh) and the decreasing production rate with 
time the agents are only able to link nodes that are 
in a distance closer than a critical distance L*, i.e. eq. 
( pl| ) makes sense only for L < L*. 

In order to get an estimation for L*, we assume that 
a minimum production rate s m i n exists, which is in the 
given model the smallest possible amount of chemical 
released by the agent (naturally it could be a molecule, 
if s is measured in molecule numbers) . With to being the 
time when the agent hits the node, we get from 



so exp 



{-/3(i-t )} 



(22) 



the maximum time t max after which the production is 



negligible: 



so 



(23) 



We can now discuss the case, that the agent moves 
straight with a constant velocity without changing its di- 
rection. Then the maximum distance crossed before the 
contribution to the field is negligible, would be: 



vt. 







so 



(24) 



Contrary, if we assume that the agent moves like a ran- 
dom walker, the average distance reached after t simu- 
lation steps, is given by the mean displacement, AR = 



\/2dD n t, which yields for d = 2: 



L av \j ^2 D n t Tl 



'2D n 



In 



(25) 



The real maximum distance that can be connected by one 
agent in the considered model, is of course between these 



limits. We have found |L( 
estimate for L*: 



that L max /2 is a reasonable 



2D„ 



< L* 



L, 



(26) 



Using this approximation, we find with eq. (^lj) and eq. 
(p4|) eventually the estimate for the threshold: 



hthr 



TV so 
A k h 



so 



1/4 



(27) 



Provided the set of parameters used for the simulations, 
we find for the threshold the value h t hr = 1.7 x 10 4 , which 
is approximately hthr ~ 2so- We note again, that this is 
an estimate that might give a rather high value because 
of the assumed worse conditions. On the other hand, it 
ensures that values for h(a,t) above the threshold really 
represent a stable connection a. 



C. Results of Computer Simulations 

After these theoretical considerations, we are now able 
to calculate the connectivity E, eq. ([13]), for the net- 
work simulated in Fig. ||. Fig. |t] shows the increase of the 
connectivity in the course of time. In agreement with the 
visible evolution of the network presented in Fig. three 
different stages can be clearly distinguished: 

1. an initial period (t < 10 2 ), where no connections 
yet exist, 

2. a transient period (10 2 < t < 10 4 ), where the net- 
work establishes, 

3. a saturation period (t > 10 4 ), where almost all 
nodes are connected, and only small fluctuations 
in the connectivity occur. 

Fig. ^ results from the single realization of the network 
shown in Fig. ^, in the average we find certain fluctua- 
tions in the connectivity due to stochastic influences that 
affect the formation of the network during the transient 
period. This leads us to the question on what parame- 
ters the connectivity of the network depends. There are 
of course the parameters affecting the production and de- 
cay of the two different chemical cues, so/kh, f3, and thus 
the positional information available to the agents. An- 
other important parameter is the average agent density 
n = N/A. If it is too low, the links will not be estab- 
lished properly, either because not all nodes have been 
detected during the transient period or because there are 
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FIG. 7: Network connectivity E eq. (|l^) vs. time t in simu- 
lation steps, calculated from the series of Fig. pi 
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FIG. 8: Network connectivity (E) eq. (|l3|), averaged over 5 
simulations vs. mean density of agents, n. Further parameters 
see Fig. B. 

not enough agents to maintain the links sufficiently. Fig. 
H shows the average connectivity (E) dependent on the 
density of agents, n. 

Here, we clearly see that below a critical density the 
connectivity is almost zero because not enough agents 
are available to establish the connections. On the other 
hand, above a certain density the connectivity reaches 
a saturation value that could be also below 1, as Fig. || 
shows. Hence, at this point an increase of the number of 
agents does not necessarily results in the establishment of 
more links. This is caused by the screening effect already 
mentioned in Sect. Ill, which eventually concentrates all 
agents to move along the established links. 

A third important impact on the establishment of the 
network results from parameter relation between a, and 
Ei which influence the agent's motion according to eq. 
(|l|). If both the response to the field, cti, and the sensi- 
tivity uJi oc l/£i are low, the agent nearly behaves as a 
random particle. On the other hand, a strong response or 
a high sensitivity may result in a decrease of stochastic 
influences, and the agent pays more attention to the ef- 



fective field that guides its motion. This in turn increases 
the screening effect and may prevent the agent from dis- 
covering unknown nodes, thus we can expect an optimal 
range of these parameters for an efficient network for- 
mation. This has been investigated in more detail in a 
subsequent paper flEf . 



V. CONCLUSIONS 

In this paper, we have proposed an agent-based model 
that shows the self-assembling of network-like structures 
between arbitrary nodes. Different from network models 
that start with the assumtion of a known set of nodes 
to be linked in a straightforward manner, we have ad- 
dressed in our model the question of how to connect a set 
of nodes without using prior information about their spa- 
tial locations or preexisting long-range attraction forces. 
This would need to solve two problems in parallel: (i) the 
detection of the appropriate nodes, and (ii) the establish- 
ment of one (or many) stable links between them. 

As we have noted in the introduction, this is a scien- 
tific problem of relevance in different areas, including the 
emergence of neural connections. In the latter case, po- 
sitional information in terms of chemical gradients plays 
an important role in guiding the neural axons to their 
destinations. In our model, we have assumed that the 
positional information about the existence of the nodes 
does not preexist, but is generated "on the fly" by means 
of Brownian agents while they are moving on the sur- 
face. Due to the non-linear feedback between the detected 
positional information and the creation of new one, we 
find the emergence of links between different nodes, along 
which the Brownian agents perform a directed motion - 
this way reinforcing and "maintaining" the links. 

Different from a circuitry for instance, for which the 
links between the nodes are determined in a top-down 
approach of hierarchical planning, the connections here 
are created by the agents bottom-up, in a process of self- 
organization. As the computer simulations have shown, 
the model turns out to be very flexible regarding the 
geometry of the nodes to be connected. Further, the net- 
works created this way are rather robust against distur- 
bances. If for example a particular link breaks down, the 
agents would be able to repair it by re-establishing the 
field, or by creating a new one. 

The basic feedback mechanism in our model is given 
by the agent's generation of (two) different kind of chem- 
ical information and the agent's response to gradients of 
these chemicals dependent on their internal state. This is 
also known as chemotaxis, i.e. the response to (gradients 
of) chemical substances and is widely found on different 
levels of biological organization. However, different from 
other self-wiring models || || we have not assumed that 
these substances due to their diffusion may have a long- 
range effect on the moving agents, or may generate at- 
tractive and repulsive forces. In our model, the chemical 
information acts only locally. It is stored in an effective 
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field that is sometimes also denoted as a self-consistent 
field, because it is generated by the agents and at the 
same time also influences their further behavior. From 
a more general perspective, the effective field plays the 
role of a communication medium among the agents, i.e. 
it stores information (external to the agents) for a cer- 
tain time (determined by the decay rate kh) and allows 
access to it under certain conditions - for instance, in 
the current model an agent can only access information 
that is at its current position and is labeled differently 
from the value of the agent's internal parameter. But the 
agents do not just respond to the information provided 
in a purely reactive manner, they also actively change it 
dependent on their internal parameter. 

The Brownian agent concept has proven its use in a 
number of applications where (positive and negative) lo- 
cal feedback processes play a considerable role, but an 
internal evolution of the agents can be neglected [ p"2| . 
The concept does not deny its inspiration from statisti- 
cal physics, using e.g. generalized Langevin equations for 
the agents or reaction-diffusion equations for the effec- 
tive field. Moreover, it purposefully stretches these analo- 
gies, in order to apply methods from statistical physics 
to derive pieces for a formal approach to multi-agent sys- 
tems (MAS). This should also include the derivation of 
a macroscopic dynamics of the MAS based on the agents 
(microscopic) dynamics, to allow some predictions of the 
collective behavior and the derivation of critical param- 
eters, etc. 

On the first glimpse, agent-based approaches seem to 
be outside of the realms of physics. Therefore, at the end 
we would like to comment on this. First of all, "agent" or 
particle-based models are also useful in physics if contin- 
uous approximations are not appropriate, for example in 
cases where only small particle numbers govern the pro- 
cess (e.g. in dielectrical breakdown or filamentary pattern 
formation). Here deterministic approaches or mean-field 
equations are not sufficient to describe the behavior of the 
system, because the influence of history, i.e. stochastic 
fluctuations, early symmetry breaks, path dependence, 
etc. play a considerable role - which can be appropriately 
captured in particle-based models. Moreover, these mod- 
els also provide a very efficient way to simulate structure 



formation processes by solving a large number of cou- 
pled "particle" equations (such as Langevin equations) 
instead of integrating a c omp licated set of coupled par- 
tial differential equations JItJ |l8| 

In many interdisciplinary applications physics nowa- 
days deals with, for example in biological physics or 
econophysics, the basic system entities do not just re- 
spond to interaction forces, but also perform certain 
types of activities, such as active motion or changes of 
the "environment" and further have internal degrees of 
freedom that allow them to act differently. Therefore, the 
"physical" particle-based approach has been extended to- 
wards an agent-based approach, where the agents already 
have an intermediate complexity to allow for certain non- 
trivial actions or responses. In the model discussed in 
this paper, the generation of two different chemical cues 
and the complex response to them are just two examples 
for such an extension. In addition to the Browian agent 
model, other agent-based approaches have been devel- 
oped based on physical principles, which focus on par- 
ticular aspects of the complex agent behavior. We jus t 
mention here active walker models g, [l9| |2^, |2l], B2j , 
where a potential can be locally changed by the walker, 
or active Brownian particles |l4|, [l^] that deal also with 
the energetic aspects of active motion. With respect to 
specific biological phenomena, there are the communicat- 
ing walker model used in the study of complex patterning 
of bacterial colonies [^3| , or the bions model used in the 
study of amoebae aggregation p4|| , or the many mod- 
els of self-driven particles to describe swarming behavior 
p5| , |26| , [27], p8[ . They jointly demonstrate, that agent- 
based models can indeed profit from the methodology 
and the tools derived in statistical physics. 
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